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Abstract 

In a topological dynamical system the complexity of an orbit is a 
measure of the amount of information (algorithmic information con- 
tent) that is necessary to describe the orbit. This indicator is invariant 
up to topological conjugation. We consider this indicator of local corn- 
er) ■ plexity of the dynamics and provide different examples of its behavior, 

showing how it can be useful to characterize various kind of weakly 
\ chaotic dynamics. We also provide criteria to find systems with non 

trivial orbit complexity (systems where the description of the whole 
r-j ■ orbit requires an infinite amount of information). We consider also a 

global indicator of the complexity of the system. This global indica- 
tor generalizes the topological entropy, taking into account systems 
were the number of essentially different orbits increases less than ex- 
. i-H ! ponentially. Then we prove that if the system is constructive (roughly 

speaking: if the map can be defined up to any given accuracy using a 
finite amount of information) the orbit complexity is everywhere less 
or equal than the generalized topological entropy. Conversely there are 
compact non constructive examples where the inequality is reversed, 
suggesting that this notion comes out naturally in this kind of com- 
plexity questions. 
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1 Introduction 

Weakly chaotic phenomena are widely studied in the physical litera- 
ture. There are connections with many physical phenomena: self orga- 
nized criticality, the anomalous diffusion processes and many others. 

In the literature a precise definition of weak chaos is not given 
and many different examples are studied. Roughly speaking a weakly 
chaotic system is a system that is chaotic in some sense (for example 
it has sensitive dependence to initial conditions) but it has zero en- 
tropy (KS-entropy or topological entropy) in this work we will mainly 
consider systems having zero topological entropy. 

For the classification of weakly chaotic systems there have been 
proposed many invariants. Some of them are defined by a general- 
ization of K-S entropy (|E|,[25].[Q) orbit complexity or based 



on growth rate of the number of different orbits with respect to a 
partition and an invariant measure (|To|l). 

Generalized orbit complexity associates to each point an indicator 
of the complexity of its orbit. This is a measure of the growth rate 
of the information that is necessary to describe the orbit while time 
increases. 

In this sense orbit complexity can be viewed as a local version 
of the entropy, where a global (average) notion of information (the 
Shannon information) is replaced by a local one (the algorithmic in- 
formation content). This is also confirmed by the relation (Theorem 



10) between entropy and orbit complexity that can be proved in the 
positive entropy case. 

Let us consider an orbit of a discrete time dynamical system. The 
definition of orbit complexity associates to the orbit a set of strings 
by a geometrical construction and then the information content of 
the strings is considered to define the complexity of the orbit. For this 
purpose we need an intrinsic (pointwise) notion of information content 
of a string. 
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Such an intrinsic notion of information content is is given for exam- 
ple by the Algorithmic Information Content ( also called Kolmogorov- 
Chaitin complexity) . Other notions of information content can be con- 
sidered ([jO]] H) but for the purposes of this paper we will only con- 
sider AIC as a measure for the information content that is contained 
in a string. 

Generalized orbit complexity turns out to be related to another 
important feature of chaos: the sensitivity to initial conditions. In 
1 14] quantitative relations are proved between the growth rate of the 
information needed to describe an orbit, quantitative indicators of 
sensitivity to initial conditions and the dimension of the underlying 
space. 

In this paper we consider a notion of orbit complexity that is partic- 
ularly suited for systems where the information necessary to describe 
an orbit increases particularly slowly as the time increases. This give 
a slight modification of the orbit complexity indicators defined in [14]. 
We also consider a sort of generalized topological entropy defining a 
family of invariants of topological dynamical systems that contains the 
classical definition of topological entropy as a special case. This gen- 
eralized topological entropy provides a family of invariants that can 
distinguish between topological dynamical systems with zero entropy, 
characterizing the global complexity of its behavior. 

One of the main results (Theorem 35) of the paper is that if a sys- 
tem is constructive (the map can be approximated by an algorithm, 
see Section 5 for a precise definition) orbit complexity (the local in- 
dicator of complexity of the system) is less or equal than generalized 
topological entropy (the global indicator) while if the system is not 
constructive this inequality does not hold, proving that constructivity 
comes out naturally when considering Algorithmic information con- 
tent based notions of complexity. 

Another main result is a criterion (Proposition 14) to find systems 
with non trivial orbit complexity. This criterion implies for exam- 
ple that a system that is chaotic in the sense of Li and Yorke has 
nontrivial orbit complexity. This criterion implies (Remark [l!]) that 
orbit complexity provides invariants that can distinguish between dy- 
namical systems that that are isomorphic in the measure preserving 
framework. 

In Section 2 we give a short introduction to the concept of algo- 
rithmic information content. 

In Section 3 we introduce two different notions of complexity of 
single orbits given by two different variants of the notion of informa- 
tion content of a string. After the definition of this invariants of the 
dynamics we give some example of its calculation in different examples 
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of dynamical systems. We also state an easy criterion (Theorem 14) 
to find systems with nontrivial orbit complexity. 

In Section 4 we define a global indicator of the complexity of a 
dynamical system. The indicator generalizes in some sense the topo- 
logical entropy, taking into account different possible asymptotic be- 
haviors of the number of substantially different orbits that appears in 
n steps of the dynamics. 

In Section 5 we introduce the concept of constructivity. Roughly 
speaking a map is constructive if the map can be approximated at 
any accuracy by some algorithm. A rigorous definition can be given 
for maps between very general metric spaces. Constructivity of the 
map underlying the dynamics is an assumption that implies interest- 
ing features of orbit complexity and relation with other indicators of 
complexity and chaos (section 6). 

In Section 6 we prove that if the map is constructive then the orbit 
complexity of each point is less or equal than the indicator of global 
complexity. Constructivity is an essential assumption. An example is 
given to show that even in the compact case there are (non construc- 
tive) maps with big orbit complexity and low global complexity. 



2 Algorithmic Information content 

In this section we give a short introduction to algorithmic information 
theory. A more detailed exposition of algorithmic information theory 
can be found in |27| or Q. 

The AIC associates to a single string a measure of the information 
content of a string, that depends (up to a constant) only on the given 
string. This is a very powerful tool and allows pointwise definitions. 

Let us consider the set T, = {0, 1}* of finite (possibly empty) binary 
strings. If s is a string we define \s\ as the length of s. 

The Algorithmic Information Content (AIC) of a string is the 
length of the smallest program to be run by some computing ma- 
chine giving the string as the output. In other words the AIC of a 
string is the length of its shorter algorithmic description. 

For example the algorithmic information content of a 2n bits long 
periodic string 

s =" 1010101010101010101010..." 

is small because the string is output of the short program: 

repeat n times (write ("10")). 
The AIC of the string s then satisfies AIC(s) < log(n) + Constant. 
This is because log(n) bits are sufficient to code "n" (in binary no- 
tation) and the constant represents the length of the code for the 
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computing machine representing the instructions "repeat...". As it is 
intuitive the information content of a periodic string is very poor. On 
the other hand each n bits long string 

s =" 1010110101010010110..." 

is output of the trivial program 

write("1010110101010010110..."). 

This has length n + constant. This implies that the AIC of each string 
is (modulo a constant which depends on the chosen computing ma- 
chine) less or equal than its length. 

The concept of computing machine can be formalized by the theory 
of Turing machines or recursive functions. For our intuitive approach 
let us think that a computing machine is an every day computer C to 
which it can be given some program to run. If we give it a program p 
(coded by some binary string) to be run and the computation stops 
we obtain an output s (another string) in this case we write C(p) = s. 
We can suppose that the output is a string made of digits in a finite 
alphabet. C then defines a function from a subset of the set of the finite 
binary strings (where the computation stops) to the set of finite strings 
from a finite alphabet. In the language of theoretical computer science 
this means that C defines a partial recursive function. If conversely the 
computation stops and the output is defined for each input then we 
say that C defines a total recursive function. Recursive functions are 
functions whose values can be calculated by some algorithm. By this 
notations we can define more formally 

Definition 1 (Algorithmic Information Content). The Kolmogorov 
complexity or Algorithmic Information Content of a string s given C 
is the length of the smallest program p giving s as the output: 

AICc(s) = min \p\, 
pes,C(p)=s 

if s is not a possible output for the computer C then AICc(s) = oo . 

In the last definition the algorithmic information content of a string 
depends on the choice of C. To avoid this problem we require that C 
is an universal machine. Roughly speaking a computing machine is 
called universal if it can emulate each other machine if an appropriate 
input is given. 

In the examples above we have that the programs are written in a 
"Pascal like" language and C is represented by a system able to run 
such program. C is then essentially a Pascal interpret. 
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Let us consider C, the above Pascal interpret and let D be a Lisp 
interpret. Since using Pascal language we can write a program L which 
is a Lisp interpret we have that for each Lisp program p we have 
D(p) = C(L,p) and then \AIC c (s) - AIC D (s)\ < \L\ for each string 
s. 

A formal definition of universal computing machine of course can 
be given. In this definition we also have to specify the meaning of the 
"," in u L,p" . Indeed a pair of binary strings can be encoded into a 
single binary string in a way that both the strings can be recovered 
from the encoded string whitout loosing information. For example such 
an encoding can be done by adding p to a self delimiting description 
of L (an encoding of L that starts specifying its length). However 
we will not go into technical details, for our scope it is sufficient to 
think to universal computing machines as our every day computer that 
can be programmed for general purposes tasks. The only important 
difference we have to consider is that theoretical computing machines 
have virtually infinite memory, that is, while computing they can write 
(and then read) data on an infinite tape. 

The important property of Universal Computing Machines (UCM) 
that will be used here is the following. 

Theorem 2. IfU andU' are universal computing machines then 
\AIC u (s) - AIC w {s)\ < K (U,W) 

where K (U,W) is a constant which depends only on U andW but not 
on s. 

This theorem sates that if we use an UCM in the definition of the 
algorithmic information content then this information content does 
not depends on the particular machine we choose in this class up to 
a constant. Since we are interested to the asymptotic behavior of the 
quantity of information this constant is not relevant and this remark 
allows to not mention the chosen machine U in the notation AICu(s) 
in the future. In the remaining part of the paper the universal comput- 
ing machine that is considered in the definition of AIC will be denoted 
byU. 

We also want to consider the information that is necessary to re- 
construct a string s once another string s' is known. 

As it was said before there are many ways to encode a pair of strings 
into a single string. Let us choose such an encoding s',s ^< s',s > 
and suppose that it is injective and recursive. 

Being universal our computing machine can be also supposed to 
be able to recognize this encoding and recover both strings from the 
encoded string. Now we can define 
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Definition 3. The conditional AIC of s given s' is the length of the 
shortest program that is able to reconstruct the string s when s' is 
given: 

AIC(s\s) = rain \p\. 

U(<s',p>)=s 

Up to a constant the definition is independent on the encoding 
that is chosen for the pair. This is because for each pair of chosen 
encodings there is an algorithm translating one encoding in the other 
for each pair of strings and this program will only add a constant in 
the definition of information content. 



3 Orbit complexity 

We give two definitions of orbit complexity. One is based on the plain 
algorithmic information content and is the definition that was given in 
1 14], the other is based on the algorithmic information of a sting given 
its length. The latter is particularly suited for very regular orbits. 

Let us consider a dynamical system (X, T). X is a compact metric 
space and T is a function X —* X. Until section 4 T is not necessarily 
supposed to be continuous. Let us consider a finite open cover = 
{Bo, Bi, i?Ar_i} of X, that is a collection of open sets whose union 
is the whole space. 

We use this cover to code the orbits of (X, T) into a set of infinite 
strings. A symbolic coding of the orbits of X with respect to the cover 
{Bi} is a string listing the sets B\, .., B n visited by the orbit of x during 
the iterations of T. Since the sets Bi may have non empty intersection 
then an orbit can have more than one possible coding. More precisely, 
if x G X let us define the set of symbolic orbits of x with respect to 
as: 

<p p (x) = {lj G {0,1, N — 1} N : Vn G N,T"(x) G B u{n) }. 

The set ipp(x) is the set of all the possible codings of the orbit of x 
relative to the cover f3. 

Definition 4. The information content of n steps of the orbit of x 
with respect to (5 is defined as 

K(x,T,(3,n)= min AICu{uj n ). 

K(x,T,(3,n) = min AICu{uj n \n). 
where u n is the string containing the first n digits of u 
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We are interested to the asymptotic behavior of this information 
content when n goes to infinity. We give a measure of such an asymp- 
totic behavior by comparing the quantity of information necessary to 
describe n step of the orbit with a function / whose asymptotic behav- 
ior is known. For each monotonic function f(n) with lim f(n) = oo 

n— >oo 

we define an indicator of orbit complexity by comparing the asymp- 
totic behavior of AICjj{<jj n ) or AICjj(iJ n \n) with /. From now on, in 
the definition of indicators / is always assumed to be monotonic and 
tends to infinity. 

Definition 5. The complexity of the orbit of x G X relative to f and 
(3 is defined as: 

K-f (x,T, (3) =limsup — - ' — - 
in a similar way we define 

K-F (x,T, (3) =limsup — ' ^' U ^ . 

n^oo f{n) 

As it is intuitive, if we refine the cover the information needed to 
describe the orbit increases. 

Lemma 6. If a and (3 are open covers of X and a is a refinement of 
(3 then for all f 

K f (x,T,(3) <K f (x,T,a) (1) 

K f \x,T,/3) < K 5 \x,T,a). (2) 

The proof of Eq. |] is contained in [|l4| the proof of Eq. |2| is essen- 
tially the same. 

As it was said before the definition of k$ is particularly suited 
for very regular strings. It considers the information contained in the 
string without considering the information contained in its length. 
Since this quantity is less or equal than log{n) then \K{x, T, (3, n) — 
K(x, T, j3,n)\ < logn + C and this implies 

Proposition 7. If log(n) = o(f(n)) then kf(x,T,/3) = Rf(x,T,j3). 

Taking the supremum over the set of all finite open covers (3 of 
the metric space X it is possible to get rid of the dependence of our 
definition on the choice of the cover [3 and define the complexity of 
the orbit of x: 
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Definition 8. The complexity of x with respect to f is defined as 
K f (x,T) = sup (K f (x,T,(3)). 

f3£{Open covers} 

K f (x,T)= sup (K f (x,T,p)). 

/3&{Open covers} 

This definition associates to a point belonging to X and a function 
/ a real number which is a measure of the complexity of the orbit of 
x with respect to the asymptotic behavior of /. In some sense in the 
above definition the function / plays a role similar to the parameter d 
in the definition of (f-dimensional Hausdorff measure. Each orbit will 
have a class of functions / such that K*(x) is finite, characterizing the 
asymptotic behavior of the information that is necessary to describe 
the orbit. 

We remark that in the definition above we used two different no- 
tions of "complexity" of a string. In principle the construction we 



made allows to use any measure of complexity of a string. In [13|, [|2[ 
for example a computable notion of information content based on data 
compression algorithms is considered. 

Generalized orbit complexity is invariant under topological conju- 
gation, as it is stated in the following theorem whose proof follows 
directly from the definitions: 

Theorem 9 (Invariance). If the dynamical systems (X,T) and (Y, S) 
are topologically conjugate, ir : X — > Y is the conjugating homeomor- 
phism, and tt(x) = y then K* (x, T) = K$ (y, S) and K* (x, T) = 
K f (y,S). 

From now on in the notation K* (x, T) we will avoid to explicitly 
mention the map T when it is clear from the context. We now give 
some example of different behaviors of K* (x). 

Periodic orbits. If x is a periodic point some of the symbolic coding 
of its orbit is a periodic string. An n digit long periodic string can be 
generated by a program containing the first period and the length of 
the string. Since n is given by the definition of conditional information 
content K(x, n, V) < C, where C is a constant not depending on n 
and K$ (x) = for each /. 

Positive entropy. In the positive entropy case the main result is 
the following 

Theorem 10 (Brudno's main theorem). Let (X,T) be a dynami- 
cal system over a compact space. If \i is an ergodic probability measure 
on (X,T), then 

K id (x,T) = hJT) 
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for fJL-almost each x G X (id is the identity function and h^(T) is the 
KS entropy). 



By theorem 1C and Proposition [5] it also follows that if a system is 
compact, ergodic and has positive Kolmogorov entropy then for almost 
all points we have K td (x) = h^ (and K^(x) = oo if / = o(id)). 

Manneville map. An important example is the piecewise linear 
Manneville map: 

TJx) = { teT^ " + & ^ * < ^ (3) 

I ?- - a < x < 1 

^ 1— a — — 

with = — — j — , k € N, z > 2. This is a piecewice linear version 

(fc+l)S=T 

of the Manneville map T z (x) = x + x z (mod 1). 

The Manneville map was introduced in (TJ| as an extremely sim- 
plified model of intermittent behavior in turbulence, then its mathe- 
matical properties was studied by many authors, And the map was 
applied as a model of other physical phenomena. By [fbl] which follows 



from [15 1 we have that if e is small enough then 

a z 

K(x, n, e)dx ~ n*- 1 

[0,1] 

i.e. the Lesbegue average information that is necessary to describe 
the orbits of the Manneville map for z > 2 increases as a power law 
with exponent — ^=r. We remark that the above Manneville map has 
positive topological entropy then it is not weakly chaotic in a topolog- 
ical sense. By the result above we can say that the Manneville map in 
some sense is weakly chaotic with respect to the Lesbegue measure. 

Logistic map at the chaos threshold. Now we calculate the com- 
plexity of the orbits of this widely studied dynamical system. We state 
a result that, using similar techniques slightly improves a result of [[| 
about the complexity of such a map. 

To understand the dynamic of the logistic map at the chaos thresh- 
old let us use a result of || (Theorem III. 3. 5.) 

Lemma 11. The logistic map fx x at the chaos threshold has an in- 
variant Cantor set Q. 

(1) There is a decreasing chain of closed subsets 

J(°>D J«D J^D..., 

each of which contains 1/2, and each of which is mapped onto itself 
by /Aoo • 
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(2) Each jM is a disjoint union of 2 Z closed intervals. is con- 
structed by deleting an open subinterval from the middle of each of the 
intervals making up JW. 

(3) fx x maps each of the intervals making up JW onto another one; 
the induced action on the set of intervals is a cyclic permutation of 
order 2\ 

(4) £1 = rijJw. fxoa maps $7 onto itself in a one-to-one fashion. Every 
orbit in £1 is dense in 0,. 

(5) For each k G N, f\ x has exactly one periodic orbit of period 2 k . 
This periodic orbit is repelling and does not belong to . Moreover 
this periodic orbit belongs to \ , and each point of the orbit 
belongs to one of the intervals of . 

(6) Every orbit of fx x either lands after a finite number of steps ex- 
actly on one of the periodic orbits enumerated in 5, or converges to the 
Cantor set 0, in the sense that, for each k, it is eventually contained 
in j( fc ). There are only countably many orbits of the first type. 

Theorem 12. In the dynamical system ([0,1], f\ x ), for each x G [0, 1] 
and each f K* (x) = 0. 

Proof. By the theorem above (point 6) we have that each point x 
either is eventually periodic (and the statement follows immediately) 
either its orbit converges to the attractor, that is the orbit of x is 
eventually contained in for each k. Now let us consider a cover V 
and let ey its Lesbegue constant. Let Ky be such that each interval 
in Jfc has diameter less than ey. Now if k > Ky each interval of J/% 
is contained in some set of V. Moreover, by point 3 above we know 
that the action of the map over is periodic. This implies that in 
the set <pv(x) of symbolic orbits of x there is an eventually periodic 
string and then the statement follows easily. □ 

Chaotic maps with zero topological entropy. In [ 23 1 Smital showed 



an interval map that is continuous, it has 0-topological entropy and it 
is chaotic in the sense of Li and Yorke. The Smital's weakly chaotic 
maps have non trivial orbit complexity, that is: there is an uncountable 
set of points S such that for each x G S there is / such that K* (x) > 0. 



This is implied by Theorem 14 below. 

In order to prove it we give the definition of weak scattering set, 
this is a notion that is weaker than the notion of scattering set used 
in the Li- Yorke definition of chaotic map (see S e.g.). 

Definition 13. A set S is called a weak scattering set if there is a 5 
such that for all x,y G S,x ^ y implies limsup d(T n (x),T n (y)) > 5. 

A point is said to have nontrivial orbit complexity if 3f with 
Kf(x) > 0. The following is an easy criterion to find systems with 
nontrivial orbit complexity. 
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Theorem 14. If (X,T) has an uncountable weak scattering set S, 
then there is a set S' with #(S') < #(S) such that for each x G S — S' 
x has nontrivial orbit complexity. 

Proof. The proof is based on a cardinality argument. First we proof 
that 3x, f such that K^(x) > 0. Conversely let us suppose that there 
are not such points. This implies that given any cover V = {B\, ...,B V } 
for each x there is a finite set of programs P x = {p l x , ...,p k x } such that 
Vn the simplest symbolic orbit uj n of x with respect to V (that is such 
that AIC{u n \n) = min AIC{uj n \n)) is such that ui n = U{p l x ,n) for 

some p % x G P x . Now the set P = {P x \x G X} is countable because is 
contained in the finite parts of a countable set (the set of all programs) . 
This implies that there is a set Z C S with jf{Z~) = #(<S) such that 
for each x G Z the set S x = {y G S, P y = P x } is uncountable. 

Now the set of possible infinite symbolic orbits associated to the 
set of programs P x is finite. Let us consider the set Wp x = {oj G 
{l,...,w} N s.t.\/n3i < k,uj n = U(p x l ,n)} (that is the set of symbolic 
orbits that can be generated from the set of programs P x ) this set 
is finite and has if(Wp x ) < k. This leads to a contradiction. By the 
definition of Wp x each point of S x must be such that there is an 
to G Wp x n <py(x) (the set Wp x is the set of the possible orbits related 
to P x ). But now, since S x C S is weakly scattering if diamiV) < 5 we 
have that if x ^ y then ipv{x) H <pv(y) = because at some time the 
orbits of the two points will be contained in sets of V having of course 
empty intersection because the distance of the two points is such that 
they cannot be in the same set of V. Since Wp x is finite then is not 
possible that Vx Wp x D (fv(x) 7^ 0- This ends the first part of the 
proof. Now let us consider the scattering set S± with S\ = S — x. Si 
does not contain x and still verifies the assumptions of the theorem, 
then by the first part of this proof there is y ^ x such that y has 
nontrivial orbit complexity. In this way by induction we prove the full 
theorem. □ 

Remark 15. By a result of Misiurewikscz (]j2(\J ) each zero entropy, 
continuous map on the interval is metrically hisomorphic to the adding 
machine for each non atomic invariant measure. 

Then even the Smital's map are hisomorphic to the adding machine 
from the measure preserving point of view. The orbit complexity of such 
maps is different from the complexity of other zero entropy continous 
maps of the interval (logistic map e.g.). 

This implies that orbit complexity in this case is more sensitive 
than any invatiant constructed in the measure-preserving framework. 
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4 Generalized topological entropy 



We give the definition of an indicator of the global topological com- 
plexity of the system. Similarly to the classical definition of topologial 
entropy. This indicator will measure the asymptotical behavior of the 
number of substantially different orbits that appears in the dynamics. 

Let X be a compact metric space and T € C (X, X). If x,y 6 X 
let us say that x, y are (n, e) separated if d(T k (x),T k (y)) > e for some 
k € {0,...,ra-l}. If d(T k (x),T k (y)) < e for each k G {0, ...,n-l} then 
x, y are said to be (k, e) near. A set E C X is called (n, e) separated 
i£x,y£E,x^y implies that x and y are (n, e) separated. 

Moreover a set E C X is called an (n, e) net if Vx € X 3y G E s.t. 
x and y are (n, e) near. 

We remark that a maximal (e, n) separated set is a (2e, n) net. 

Let us consider as in the classical definition of topological entropy 

s(n, e) = max{card(E) : E C X is (n,e) — separated}. 
We choose a monotone function / such that lim f(n) = oo as 

n— >oo 

before and define 

h,f(T,e) =limsup °^ff n ' ^ 

IrJ (T, e) is monotone in e so we can define 

/?/(T) =lim h f (T,e). 

Let us consider 



r(ra, e) = min{card(E) : E C X,E is a (n,e) net}. 



Since r(n,e) < s(n, e) and (see [21 p. 268) s(n,e) < r(n, | 



m 



the definition of generalized topological entropy hJ we can also con- 
sider instead of s(n, e) the number r(n, e) and obtain an equivalent 
definition. 

We also give a third equivalent possible definition, using open cov- 
ers. Let U and V two open covers of X. We denote by U V V the least 
common refinement (or join) of U and V. If U is an open cover, let us 
denote by N(U) the minimum cardinality of the subcovers of U, and 
let H(U) = log{N(U)). Let us consider 

f/m Trt , H{U\JT- l (U)\J ...vr n ((7)) 
(T, [/) =limsup — 
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and 

h/(T) = sup h f (T,U). 

finite open covers 



We remark that (see |yj page 268) if e > diam(U) then 

N(U V r _1 (a) V ... V T" n (C/)) > s(n, e) 
and if e is the Lesbegue number of U then 

iV(£/ V T _1 (C/) V ... V r" n (C/)) < r(n, e). 
By this it follows that 

Proposition 16. For each f (T) = h* (T) and the definitions are 
equivalent. 

By this is also follows that h* is invariant under isomorphisms of 
dynamical systems. 

Proposition 17. If(X,T), (Y,T') are topological dynamical systems, 
if) : X — > Y is an homeomorphism such that 

X -> Y 

T I IT' (4) 

X -> y 

commutes, then for each f h* ((X, T)) = ((Y,T')). 

Proof. Since i/> is an homeomorphism then it sends an open cover 
of X to an open cover of Y and it is easy to see that since the diagram 
commutes h/ ((X, T)) = h/((y, T')). By Proposition 16 we also have 
hf{(X,T))=hf((Y,T')). □ 

Now we state a result which is useful to characterize the systems 
where the generalized topological entropy is null for each /. 

Definition 18. A system (X, T) is said to be equicontinuous if for 
any e > there is n > such that if x, y E X with d(x, y) < rj then 
for any n 6 N one has d(T n (x),T n (y)) < e. 

If (X, T) is not equicontinuous there are e > and a point x G X 
such that for any r] > one can find y € X with d(x, y) < rj and 
n G N such that d{T n {x),T n {y)) > e. 

A point x G X is called an equicontinuity point if for any e > 
there is ij > such that if y G X with y) < n then for any n G N 
one has d(T n (x),T n (y)) < e; obviously a system is equicontinuous if 
all its points are equicontinuity points. 
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Let us cite the following fundamental result from 0] about the 
topological complexity of a dynamical system. 

Theorem 19. Let (X, T) be a dynamical system, X is compact, T is 
continuous The two following statement are equivalent: 

(1) (X,T) is equicontinuous. 

(2) For any finite open cover U ofX, A^C/VT^C/) V... VT~™([/)) 
is bounded. 

By this it follows that 

Proposition 20. (X,T) is equicontinuous if and only if for each f it 
holds hf((X,T)) = 0. 

The next result shows that for the logistic map at the chaos thresh- 
old 3 / such that K-^(x) < hf(T) for each x € [0, 1]. This is an example 
of a system where local and global complexity are quite different. In 
the following (Theorem ^5|) we will see that in general K*(x) < W (T) 
for a wide class of dynamical systems. 

Theorem 21. The logistic map f\ x is not equicontinuous and then 
there is some f such that h* (fx^) > 0. 

Proof. By Lemma |ll] we have that either an orbit is eventually 
periodic or it converges to the attractor O and the orbit is dense on 
the attractor, then let p be periodic and r = d(orb(p) , f2) . In each 
neighborhood of the periodic point there is a point x that converges 
to the attractor and then limsup(d(T n (x),T n (p))) > r. The point p 
cannot be an equicontinuity point. The statement follows then from 
Theorem |l| □ 

5 Computable Structures, Construc- 
tivity 

In this section we give a rigorous notion of constructive map and the 
results about constructive mathematics that are necessary in the fol- 
lowing. Constructive functions can be considered in some sense as 
algorithms acting over metric spaces. All function that can be con- 
cretely defined and effectively calculated are constructive. Algorithms 
works with strings, if strings are interpreted as points of a metric space 
we have the possibility to relate the world of continuum mathemat- 
ics with the world of algorithms. This is what is currently done when 
expressing a point of a metric space by a symbolic notation. For exam- 
ple ^ is a symbolic string that represents a point of the metric space 
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R and allows to calculate a symbolic representation for the value of 
sin(^) by some algorithm (because sin is a constructive function). 
An interpretation function is a way to interpret a string as a point 
of the metric space. An interpretation is said to be computable if the 
distance between ideal points is computable with arbitrary precision: 

Definition 22 (Computable interpretation). A computable inter- 
pretation function on (X, d) is a function I : S — > X such that /(£) is 
dense in X and there exists a total recursive function D : ExSxN-* 
Q such that Vsj, S2 G X, n G N: 

\d(I(s 1 ),I(s 2 ))-D( Sl ,s 2 ,n)\<y i . 

A point x £ X is said to be ideal if it is the image of some string: 
x = I(s), s G S. 

Two interpretations are said to be equivalent if the distance from 
an ideal point from the first and a point from the second is computable 
up to arbitrary precision. 

Definition 23 (Equivalence of interpretations). Let l\ and I 2 

be two computable interpretations in (X,d); we say that I\ and I 2 are 
equivalent if there exists a total recursive function D* : SxSxN^ Q, 
such that Vsi, s 2 G E, raG N: 

\d(I 1 (s 1 ),I 2 (s 2 ))-D*(si,s 2 ,n)\ <± 

For example, finite binary strings s G £ can be interpreted as 
rational numbers by interpreting the string as the binary expansion 
of the number. Another interpretation can be given by interpreting 
a string as an encoding of a couple of integers whose ratio gives the 
rational number. If the encoding is recursive, the two interpretation 
are equivalent. 



Proposition 24. The relation defined by definition 25 is an equiva- 
lence relation. 

For the proof of the above proposition see []ll]] . 

Definition 25 (Computable structure). A computable structure 
2 on X is an equivalence class of computable interpretations in X . 

Remark 26. We remark as a property of the computable structures 
that if B r (I(s)) is an open ball with center in an ideal point I(s) and 
rational radius r and I(t) is another point then there is an algorithm 
that verifies if I(t) G B r (I(s)). If I(t) G B r (I(s)) then the algorithm 
outputs "yes", if I(t) £ B r (I(s)) the algorithm outputs "no" or does 
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not stop. The algorithm calculates D(s, t, n) for each n until it finds 
that D(s,t,n) + 2~ n < r or D(s,t,n) — 2~ n > r, in the first case it 
outputs "yes" and in the second it outputs "no". If d(I(s),I(t)) 7^ r 
the algorithm will stop and output an answer. 

We give a definition of morphism of metric spaces with computable 
structures. A morphism is heuristically a computable function between 
computable metric spaces. The definition states that if ^ is a mor- 
phism the image of an ideal point can be calculated up to arbitrary 
precision by an algorithm. 

Definition 27 (Morphism between computable structures). // 

(X,d,Z) and (Y,d',^T) are spaces with computable structures; a func- 
tion ^ : X — > Y is said to be a morphism of computable structures if 
* is continuous and for each pair I G I, J G J there exists a total 
recursive function D* : S x S x N -t Q, such that Vsi, S2 G S, nG N: 

\d'(V(I( Sl )),J(s 2 )) - D*( Sl ,s 2 ,n)\ < ± 

We remark that *S> is not required to have dense image and then 
\t (/(*)) is not necessarily an interpretation function equivalent to J. 

Remark 28. As an example of the properties of the morphisms, we 
remark that if a map ^ : X — > Y is a morphism then given a point 
x G -/"(£) <Z X it is possible to find by an algorithm a point y G J(S) C 
Y as near as we want to Vl/(x). 

The procedure is simple: if x = I(s) and we want to find a point y = 
J(z ) such that d'(W(I(s)),y) < 2" m then we calculate D*(s,z,m + 2) 
for each z <G E until we find zq such that D*(s,zo,m + 2) < 2~ m ~ 1 . 
Clearly y = J(zq) is such that d'(*S>(x),y) < 2~ m . The existence of 
such a zq is assured by the density of J in Y. We also remark that 
by a similar procedure, given a point I(sq) and e G Q it is possible to 
find a point l(si) such that d(I(so), l(si)) > e. 

A constructive map is a morphism for which the continuity relation 
between e and S is given by a recursive function. 

Definition 29 (Uniformly constructive functions). A function 
^ : X — > Y between spaces with computable structure (X,d,I), 
(Y-,d',J) is said to be uniformly constructive if ^ is a morphism be- 
tween the computable structures and it is effectively uniformly contin- 
uous, i.e. there is a total recursive function f : N — > N such that for 
all x, ye X d(x,y) < 2'?^ implies d'(V(x), < 2~ n . 

If a map between spaces with a computable structure is uniformly 
constructive then there is an algorithm to follow the orbit each ideal 
point x = I (so). 
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Lemma 30. If T : (X,X) — > (X,2) is uniformly constructive, I €l 
then there is an algorithm ( a total recursive function) A: ExNxN-> 
E such that Vfc, m G N, s € E d(T k (I(s )), I(A(s , k, m))) < 2~ m . 

Proof. Since T is effectively uniformly continuous we define the 
function ^fc(m) inductively as gi(m) = /(m) + l, gi(m) = f(gi-i(m) + 
1) where / is the function of effective uniform continuity of T (def- 
inition H). If d{x,y) < 2-^(m) then d(T i (y),T i (x)) < 2~ m for i e 
{1, Let us choose I Gl. We recall that the assumption that T 
is a morphism implies that there is a recursive function D*(s\,s 2 ,n) 
such that 



\D*( Sl ,s 2 ,n) - d(I( Sl ),T(I(s 2 )))\ < 2~ n . 

Let us suppose that x = I(sq). Now let us describe the algorithm 
A: using the function D* and the function /, A calculates gk(m) 
and finds a string s± such that d(I(s\),T(I(so))) < 2~ 9k ( m ^ as de- 
scribed in remark |2^. This is the first step of the algorithm. Now 
d(T(I( Sl )), T 2 (x)) < 2-(^-i +1 ). We can use D* to find a string s 2 such 
that d(/(s 2 ),T(/(si))) < By this d{I{s 2 ),T 2 (x)) < 2^-1. 

This implies that d(T(I(s 2 )),T 3 (x)) < 2^-2+1)^ then we find s 3 such 
that d(I(s 3 ),T(s 2 )) < 2~^ k -^ and so on for k steps. At the end we 
find a string s k such that d(I(s k ),T k (x)) < 2" m . □ 

Let us describe a certain class of nice balls covers that will be used 
in the following. 

Definition 31. If a = {Bi(yx, n ),..., B n (y n , r n )} is a ball cover of 
the metric space X whose elements are balls with centers yi and radii 
Ti. We say that a is a nice cover if X CU Bi(yi, 5-)- 

i 

In other words a is a nice cover if dividing the radius of the balls 
by 2 we have again a cover. 

Remark 32. We remark that since the space is compact each open 
cover has a refinement which is a nice cover. 

Remark 33. If we have a nice cover a = {B±(y±,r), B n (y n ,r)} 
made of balls with ideal centers yi = I(si) and rational radius and we 
have x £ X and an ideal point y = I(s) such that d(x, y) < | then 
it is possible to find a ball of a that contains x. Indeed we find by the 
properties of computable interpretations an yi such that d(y, yi) < | 
(see Remark \2(\ ). This is possible because the cover is nice. The ball 
in the cover with center yi will contain x. 

By the above remark if we have an algorithm A() to follow the orbit 



of ideal points as in Lemma 3C and a nice cover a = {B\(y\,r), B n (y n 
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made of balls with ideal centers and rational radius for each ideal point 
x and n it is possible to find by an algorithm a set B of a such that 
T n (x) E B and then we can construct a symbolic orbit of x relative 
to a. We remark that if n is given (by the definition of AIC(s\n)) the 
lenght of a code implementing such an algorithm does not depend on 
n. Then we have 

Lemma 34. Let (X,Z) is a metric space with a computable structure 
and 

• {B(x{, 7")}i<j< m is a nice cover made of balls with ideal centers 
and rational radius r, 

• x E X is an ideal point 

• Pr : N — > S is such that \/k E {1, ...,n} 

d(T k (x),I(Pr_(k)))< r - 

is an algorithm to follow the orbit of x with accuracy | similar 
as above in Lemma \3Q. 

then there is an algorithm P' : N — ► {1, m} such that Mi < k, P'(i) = 
j ifT l {x) E B(xj,r). Moreover the length of a code implementing P 
on an universal Turing machine is equal to the code for P' up to a 
constant that does not depend on n. 

6 Gen. Top. Entr. and Orbit complex- 
ity 

Theorem 35. Lf X is compact and (X, T) is constructive (for some 
computable structure over X ) then for each f and each x E X 

K f (x) < h f (T). 

Proof. Since the system is constructive by the use of the algorithm 
AQ (Lemma |30| ) following the orbit of an ideal point at any given 
accuracy and Z)() approximating the distance d at any given accuracy 
we have the following. If x, y are ideal, I(z) = x, L(w) = y and k E 
N, e E Q then there is a procedure P(z, w, e, k) such that if there is 
a i < k such that d(T l (x),T l (y)) > e then the procedure stops with 
output "YES". 

We also remark that if x = I(z) is ideal I(z) = x and there is y E X 
such that x, y are (n, e) separated then we can find by a procedure 
P'(z, n, e) an ideal y' such that x, y' are (n, e) separated. The procedure 
P' calculates P(z, v, n, e) for all strings v in a "parallel" way until it 



19 



finds a v stopping the procedure with output YES. Such a v must 
exist by the density of I and the continuity of the map T. 

We will prove that if j3 = {B(xi,2e), B(x n , 2e)} is a nice cover 
with ideal centers and rational radius and e is small enough, then for 
each k £ N and Vx € X there is a program p^^ such that U(pk, e , k) is 
a symbolic coding of the first k steps of the orbit of x with respect to 
(3 and \p k , e \ < log{s(k, §)) + C. 

The idea is that by the constructivity (as it is said above) we can 
construct (n, e) separated sets and use them to select the points that 
give rise to separate orbits, moreover the number of these points is 
bounded by the topological entropy. Now let us see a more precise 
description of such a procedure. 

The program p k ,t we want to describe now will contain a number 
n x with n x < s(k, |) and a procedure to construct a symbolic orbit of 
x. The procedure runs as follows 

First let us consider an empty list of strings: list=0 



For each i € N,i < n x do :{ by the above procedure P'Q 
find an ideal point that is (k, |) separated from the points 
in the list and add the corresponding string to the list } 



Follow by the algorithm AQ (Lemma 30) with accuracy 
e the last point found in the list. 

By the procedure stated in Lemma 34 produce a symbolic 
string associated to the cover j3. 



We remark that in the above procedure the number k is given by 
the definition of AIC{s\k). 

If n x is big enough the previous procedure construct a maximal 
(k, |) separated set. Now since a maximal (k, |) separated set is also 
a (k, e) net, then each x G X is e near to some point found by the 
procedure above. The procedure then follows by the algorithm A() 
with accuracy e the orbit of such a point and then produce the sym- 
bolic list associated with the given cover. Since n x < s(k, |) then 
\Pk\ ^ log{s{k, |)) + C and the statement follows. □ 

The assumption of constructivity in the above theorem is essential. 
There are examples of dynamical systems that are not constructive for 
any computable structure and violates the above inequality for each 
point. 

Example 36. Let us consider (X,T) with X = S 1 and T(x) = x + 
r (mod 1) where r is a non constructive number (See Ji^/ for the 
definition of such numbers, see below for an example). 
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In this example, since T is an isometry we have h f {T) = for all 
f. But if r is not constructive there is some f such that K^(x) > 
for all x. 

The idea is that the knowledge of many steps of a symbolic orbit 
for x with respect to the cover (3 implies the knowledge of many digits 
of r. 

In the following proposition we prove this fact when r = 0.rir2... 
(binary expansion of r) is such that Urn AIC ^--- rn ^ = \ we ca \\ ran . 

dom such a real (this condition is satisfied for Lesbegue almost all 
reals). The proposition in the other cases is a straightforward gener- 
alization. 

Proposition 37. In the above example if r is random we have that 
for each xeX K log (x) > and h f (T) = for each f. 

Proof. Let x € S 1 and j3 = {B(x\, r), B(x n , r)} a cover of S 1 
with rational centers and radius. Without loss of generality we can 
suppose x = 0. 

Let pk be a program generating a sequence u>\, ...,ujk-i such that 

By the use of pk it is possible to find a rational q such that in the 
dynamical system T' : S 1 — > S 1 defined by T'(x) = x + q (mod 1) the 
orbit of has the same associated k steps symbolic orbit. 

Since Vi < k, d(T*(0), T'^O)) < 2e then |r - q\ < ^ and then 
the knowledge of k steps of the orbit of with accuracy e implies 
the knowledge of r up to accuracy This implies the knowledge of 
log(h) + C binary digits of r. If r was a random real this implies the 
statement. □ 

In |12| ] an example was given of a non constructive system over 
a non compact space having large orbit complexity while the map 
defining it is equicontinuous. This example showed in the non compact 
case that constructivity is essential to relate the complexity of the 
behavior of a system and chaos. 

The last proposition implies that even in the compact case this is 
true. Constructivity comes out naturally when considering definitions 
of complexity which are based on the algorithmic information content. 
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